Image processing method, electronic device and medium

ABSTRACT

An image processing method includes: obtaining a first image photographed by each of N color cameras in the M color cameras; obtaining, for each first image, luminance values of at least a part of pixels in the first image; and increasing brightness of a target image by using the obtained luminance values, and using the target image with increased brightness as an image photographed by the under-screen camera assembly, the target image being the first image photographed by one of the N color cameras, where both M and N are integers greater than or equal to 2, and N is less than or equal to M.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Bypass Continuation Application ofPCT/CN2020/116887, filed on Sep. 22, 2020, which claims priority toChinese Patent Application No. 201910921251.6, filed on Sep. 27, 2019,which are incorporated herein by reference in their entirety.

TECHNICAL FIELD

This application relates to the field of data processing, and inparticular, to an image processing method and apparatus, an electronicdevice, and a medium.

BACKGROUND

With the rapid development of technologies of the mobile intelligentelectronic device, users' demand for the mobile intelligent electronicdevice is increasing. Various mobile phone manufacturers are trying toincrease a screen-to-body ratio of the electronic device to improve theuser experience. However, because the lens of the front-facing cameramust have a specific transmittance, a black block may be formed on thedisplay screen and the lens area of the camera, and the picture cannotbe displayed, which affects the user experience.

SUMMARY

This application provides an image processing method and apparatus, anelectronic device, and a medium.

A first aspect of this application provides an image processing method,performed by to an electronic device, the electronic device includes anunder-screen camera assembly, and the under-screen camera assemblyincludes M color cameras, where

the image processing method includes:

obtaining a first image photographed by each of N color cameras in the Mcolor cameras;

obtaining, for each first image, luminance values of at least a part ofpixels in the first image; and

increasing brightness of a target image by using the obtained luminancevalues, and using the target image with increased brightness as an imagephotographed by the under-screen camera assembly, the target image beingthe first image photographed by one of the N color cameras, where

both M and N are integers greater than or equal to 2, and N is less thanor equal to M.

According to a second aspect, this application provides an imageprocessing apparatus, performed by an electronic device, the electronicdevice includes an under-screen camera assembly, and the under-screencamera assembly includes M color cameras, where the image processingapparatus includes:

an image obtaining module, configured to obtain a first imagephotographed by each of N color cameras in the M color cameras;

a luminance value obtaining module, configured to obtain, for each firstimage, luminance values of at least a part of pixels in the first image;and

a brightness increasing module, configured to increase brightness of atarget image by using the obtained luminance values, and use the targetimage with increased brightness as an image photographed by theunder-screen camera assembly, the target image being the first imagephotographed by one of the N color cameras, where

both M and N are integers greater than or equal to 2, and N is less thanor equal to M.

According to a third aspect, this application further provides anelectronic device, including:

an under-screen camera assembly, including M color cameras; and

an image processing apparatus, configured to obtain a first imagephotographed by each of N color cameras in the M color cameras; obtain,for each first image, luminance values of at least a part of pixels inthe first image; and increase brightness of a target image by using theobtained luminance values, and use the target image with increasedbrightness as an image photographed by the under-screen camera assembly,the target image being the first image photographed by one of the Ncolor cameras, where both M and N are integers greater than or equal to2, and N is less than or equal to M.

According to a fourth aspect, this application further provides anelectronic device, including a processor, a memory, and a computerprogram that is stored in the memory and may run on the processor, andwhen the computer program is executed by the processor, the imageprocessing method according to the first aspect of this application isimplemented.

According to a fifth aspect, this application further provides anon-transitory computer-readable storage medium on which computerprogram instructions are stored, and when the computer programinstructions are executed by a processor, the image processing methodaccording to the first aspect of this application is implemented.

BRIEF DESCRIPTION OF THE DRAWINGS

It may be better understood from the following descriptions of specificimplementations of this application with reference to the accompanyingdrawings that same or similar reference numerals represent same orsimilar features in this application.

FIG. 1 is a schematic flowchart of an embodiment of an image processingmethod according to a first aspect of this application;

FIG. 2 is a front view of an example of an electronic device to which animage processing method of a first aspect of this application may beapplied;

FIG. 3 is a top view of an example of an under-screen camera assemblyincluding four color cameras in an example of an electronic device;

FIG. 4 is a front view of an example of a color camera in an example ofan electronic device;

FIG. 5 is an exploded view of a color camera in FIG. 4 ;

FIG. 6 is a top view of an example of an under-screen camera assemblyincluding two color cameras in an example of an electronic device;

FIG. 7 is an exploded view of two color cameras in FIG. 6 ;

FIG. 8 is a schematic diagram of an example of a target area of a firstimage according to an embodiment of this application;

FIG. 9 is a schematic diagram of an example of a correspondence betweendifferent pixels in a first image according to an embodiment of thisapplication;

FIG. 10 is a schematic structural diagram of an embodiment of an imageprocessing apparatus according to a second aspect of this application;and

FIG. 11 is a schematic structural diagram of an embodiment of anelectronic device according to this application.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The following clearly describes the technical solutions in theembodiments of this application with reference to the accompanyingdrawings in the embodiments of this application. Apparently, thedescribed embodiments are some but not all of the embodiments of thisapplication. All other embodiments obtained by a person of ordinaryskill in the art based on the embodiments of this application withoutcreative efforts shall fall within the protection scope of thisapplication.

At present, the design of digging a hole in the display screen or thebacklight area, such as the under-screen water drop screen, may increasethe screen-to-body ratio of the mobile phone to a specific extent.However, from the front view, the user may still see a black dot leftfor the camera, and the full-screen display has not yet been fullyrealized.

The full-screen display may be realized when the camera is placed belowthe display screen, but because the display screen only has a specificlight transmittance, the brightness of the image photographed by thecamera is very low.

FIG. 1 is a schematic flowchart of an embodiment of an image processingmethod 100 performed by an electronic device according to a first aspectof this application. As shown in FIG. 2 , an electronic device 200 towhich the image processing method 100 provided in this application isapplied includes:

a display panel 210 with a first surface 210 a and a second surface 210b opposite to each other, the first surface 210 a being a displaysurface of the display panel 210, and the display panel 210 including alight-transmitting area 210 c; and

an under-screen camera assembly 220, disposed at a side of the secondsurface 210 b of the display panel 210 and corresponding to thelight-transmitting area 210 c, and the under-screen camera assembly 220including M color cameras, where M is an integer greater than or equalto 2.

The display panel 210 in the light-transmitting area 210 c may be madeof light-transmitting materials such as glass or polyimide (PI).

In this embodiment of this application, the electronic device includesbut is not limited to a mobile phone, a tablet computer, a notebookcomputer, a palmtop computer, a vehicle-mounted terminal, a wearabledevice, or the like.

In this embodiment of this application, the M color cameras in theunder-screen camera assembly 220 may be arranged according to a presetrule. For example, the M color cameras may be arranged along a presetarc track, arranged along a preset circular track, or arranged in anarray. As an example, the under-screen camera assembly 220 includes fourcolor cameras arranged in an array, and FIG. 3 is a top view of the fourcameras.

In some embodiments of this application, the color cameras in theunder-screen camera assembly 220 have a same structure. FIG. 4 and FIG.5 are respectively a side view and an exploded view of the color camera.As shown in FIG. 4 , the color camera includes a lens 407, aphotosensitive chip 408, a circuit board 409 connected to thephotosensitive chip 408, a lens holder 410, and a filter component 411.As an example, the circuit board 409 may be a flexible printed circuit(FPC). The lens 407 is a condenser lens.

Referring to FIG. 4 , the lens holder 410 is disposed on the circuitboard 409. The lens 407 and the filter component 411 are disposed on thelens holder 410. Referring to FIG. 5 , the lens holder 410 includes afirst mounting portion 410 a and a second mounting portion 410 b. Thefirst mounting portion 410 a is used to mount the lens 407. In someembodiments, the lens 407 may be connected to the first mounting portion410 a through threads. A plurality of lenses may be installed in thelens 407. The second mounting portion 410 b is used to mount the filtercomponent 411. The filter component 411 is disposed in a cavity of thelens holder 410.

Referring to FIG. 4 , the lens 407 and the photosensitive chip 408 aredisposed opposite to each other, and the photosensitive chip 408 isdisposed on the circuit board 409 and is electrically connected to thecircuit board 409. Referring to FIG. 5 , the filter component 411 islocated between the lens 407 and the photosensitive chip 408, and isused to implement a filter function during a shooting process.

In this embodiment of this application, the color camera furtherincludes a connector 412, the connector 412 is disposed on the circuitand is electrically connected to the circuit board 409, and theconnector 412 is used to connect an external device to transmit powerand information for the color camera.

In some embodiments of this application, in order to save internal spaceof the electronic device, two color cameras of the under-screen cameraassembly 220 may share the circuit board 409 and the connector 412. FIG.6 and FIG. 7 are respectively a top view and an exploded view of the twocolor cameras sharing the circuit board 409 and the connector 412.

In this embodiment of this application, it is not necessary to dig ahole in the display screen or the backlight area by disposing theunder-screen camera assembly 220 at the side of the second surface 210 bof the display panel 210, and the full-screen display of the electronicdevice may be realized. In a case that the electronic device hasrealized the full-screen display, the light-transmitting area 210 c ofthe display panel 210 also needs to have a display function, but thelight-transmitting area 210 c only has a specific light transmittance.Therefore, to ensure that an image photographed by the under-screencamera assembly 220 under the display panel 210 has higher brightness,the image processing method shown in FIG. 1 is required.

Referring to FIG. 1 , the image processing method 100 provided in thisapplication includes S110 to S130.

S110: Obtain a first image photographed by each of N color cameras inthe M color cameras.

S120: Obtain, for each first image, luminance values of at least a partof pixels in the first image.

S130: Increase brightness of a target image by using the obtainedluminance values, and use the target image with increased brightness asan image photographed by the under-screen camera assembly 220.

The target image is the first image photographed by one of the N colorcameras. N is an integer greater than or equal to 2, and N is less thanor equal to M.

In this embodiment of this application, an independent lens 407 isdisposed above a photosensitive chip 408 of each color camera in theunder-screen camera assembly 220, and the lens 407 may imageindependently. For each color camera, a combination of thephotosensitive chip 408 and the lens 407 in the color camera may ensurethat each color camera has a specific light transmittance. Compared withdisposing a single camera under the display panel 210, at least twocolor cameras are disposed at a side of the second surface 210 b of thedisplay panel 210 and are corresponding to the light-transmitting area210 c, which may increase brightness collected by the under-screencamera assembly 220, namely, the light transmittance of the under-screencamera assembly 220 is improved. Therefore, the luminance values of theat least a part of pixels in the first image collected by each colorcamera are used to increase the brightness of the selected target image,and the target image with increased brightness is used as an imagephotographed by the under-screen camera assembly 220, thereby increasingthe brightness of the image photographed by the under-screen cameraassembly 220.

In some embodiments of this application, an image photographed by acolor camera at a preset location of the N color cameras may be taken asthe target image. As an example, if at least two cameras are arranged ina line, an image photographed by a color camera at the center positionmay be taken as the target image.

In some embodiments, S120 includes S1201 to S1205.

S1201: Obtain a target photographing distance between the under-screencamera assembly 220 and the target object of the under-screen cameraassembly 220.

In this embodiment of this application, the target photographingdistance is a distance between the under-screen camera assembly 220 anda target object to be photographed. Due to a close distance between eachcolor camera in the under-screen camera assembly 220, it may beconsidered that the photographing distance from each color camera to thetarget object is the same.

It is worth mentioning that when the under-screen camera assembly 220needs to photograph the target object, the light-transmitting area 210 cabove the under-screen camera assembly 220 should be extinguished, thatis, the display function is suspended.

S1203: Obtain a target area of each first image at the targetphotographing distance based on a predetermined target area in an imagephotographed by each color camera at pre-stored different photographingdistances.

In this embodiment of this application, the under-screen camera assembly220 may be calibrated in advance, that is, each color camera of theunder-screen camera assembly 220 is used to photograph a calibratedobject at different photographing distances. At any photographingdistance, for images photographed by each color camera, a position areaof the calibrated object in the image is taken as a predetermined targetarea of the image. The calibrated object may be a target object to bephotographed, or other objects to be photographed. If the calibratedobject is the target object, a predetermined target area of a pre-storedimage photographed by the color camera at any photographing distance isa position area in which the target object is located in the image.

As an example, the predetermined target area may be expressed by using apixel coordinate range. At any photographing distance, a quantity ofpixels in the predetermined target area of the image photographed byeach color camera is the same. At a photographing distance, each pixelin the predetermined target area of the image photographed by one colorcamera has a pixel with same color information in a correspondingposition of a predetermined target area of an image photographed byother color cameras.

As shown in FIG. 8 , as an example, the under-screen camera assembly 220includes four color cameras, and it is assumed that a size of a firstimage photographed by each camera for the target object is 8 pixels×8pixels. An area of 4 pixels×4 pixels in a thick black frame in eachfirst image is the target area corresponding to the first image. Thetarget area in FIG. 8 is only a schematic diagram, and the size of theimage in FIG. 8 is only for reference, and is not specifically limited.In some embodiments, the size of the first image may be 8 millionpixels×8 million pixels.

S1205: Obtain, for each first image, a luminance value of each pixel inthe target area of the first image.

In some embodiments of this application, a luminance value of each pixelin a target area of each first image needs to be used to increase theluminance value of the pixel in the target area of the target image.Therefore, luminance values of all pixels in the target area of eachfirst image need to be obtained first.

After obtaining the luminance value of each pixel in the target area ofeach first image, step S140 includes S1401 to S1402.

S1401: Use each pixel in a target area of the target image as a firsttarget pixel.

In this embodiment of this application, the luminance value of eachpixel in the target area of the target image needs to be increased, andtherefore, each pixel in the target area of the target image may be usedas the first target pixel.

S1402: Add, for each first target pixel, a luminance value of the firsttarget pixel to a first luminance value to obtain a first targetluminance value, and increase the luminance value of the first targetpixel to the first target luminance value.

The first luminance value is a sum of luminance values of pixelscorresponding to the first target pixel in a target area of each firstimage other than the target image.

It should be noted that each first target pixel has a correspondingposition in the target area of each first image other than the targetimage, and pixels in the corresponding position have same colorinformation.

As an example, referring to FIG. 8 , pixels in an i-th row and j-thcolumn of each target area are in the corresponding position, and colorinformation of pixels in the corresponding position of each target areais the same.

Referring to FIG. 8 , there are 4 corresponding pixels in a first rowand first column of each target area, and color information of the fourpixels is red. If a first image photographed by a first color camera isthe target image, the pixel in the first row and first column of thetarget area in the upper left corner of FIG. 8 is the first targetpixel, and it is assumed that a luminance value of the first targetpixel is R1. It is assumed that a luminance value of the pixel in thefirst row and first column of the target area in the upper right cornerof FIG. 8 is R2, a luminance value of the pixel in the first row andfirst column of the target area in the lower left corner of FIG. 8 isR3, and a luminance value of the pixel in the first row and first columnof the target area in the lower right corner of FIG. 8 is R4, where

the first luminance value R′=R2+R3+R4. The first target luminance valuetotal R corresponding to the pixels in the first row and first column ofthe target area of the target image is R1+R′=R1+R2+R3+R4. Then theluminance value of the pixel in the first row and first column in thetarget area of the target image is increased to the total R.

According to the similar method mentioned above, the luminance value ofeach pixel in the target area of the target image may be increased. Thenthe target image with increased brightness in the target area is used asthe image photographed by the under-screen camera assembly 220 for thetarget object.

In this embodiment of this application, luminance values of all pixelsin a target area of each first image are used to increase a luminancevalue of each pixel in the target area of the target image, therebyincreasing the brightness of the image photographed by the under-screencamera assembly 220.

In this embodiment of this application, fields of view of all cameras inthe under-screen camera assembly 220 have a same overlapping area. Sincea field of view of each color camera has a same overlapping area, theimage photographed by each color camera has a corresponding target area.

The closer the distance between each color camera in the under-screencamera assembly 220 is set, the more the quantity of pixels included inthe target area of each first image, which may further increase overallbrightness of the image photographed by the under-screen camera assembly220.

In some embodiments of this application, in order to reduce brightnessdifference between the target area and a non-target area in the imagephotographed by the under-screen camera assembly 220 for the targetobject, in step S140, a luminance value of each pixel in the non-targetarea of the target image may further be obtained, and then the obtainedluminance value of each pixel in the non-target area of the target imageis increased by a preset multiple.

As an example, the preset multiple is N−1 times. In other words, theluminance value of each pixel in the non-target area of the target imageis adjusted to N times the original.

In other embodiments of this application, in order to improve an imageprocessing speed, the luminance values of all the pixels in each firstimage may be directly used to increase the brightness of the targetimage instead of obtaining the target area of each first image.Optionally, in step S120, obtain, for each first image, luminance valuesof all pixels in the first image.

After obtaining the luminance values of all the pixels in each firstimage, step S140 includes S1401′ to S1402′.

S1401′: Use each pixel in the target image as a second target pixel.

S1402′: Add, for each second target pixel, a luminance value of thesecond target pixel to a second luminance value to obtain a secondtarget luminance value, and increase the luminance value of the secondtarget pixel to the second target luminance value.

The second luminance value is a sum of luminance values of pixelscorresponding to the second target pixel in each first image other thanthe target image.

In some embodiments of this application, each first image has a samesize, all the pixels in the i-th row and j-th column of each first imageare taken as pixels corresponding to each other, and correspondingpixels in each first image have same color information.

Referring to FIG. 9 , there are 4 corresponding pixels in a first rowand second column of each first image, and color information of the fourpixels is green. It is assumed that a luminance value of the pixel inthe first row and second column of the first image in the upper leftcorner of FIG. 9 is G1, a luminance value of the pixel in the first rowand second column of the first image in the upper right corner of FIG. 9is G2, a luminance value of the pixel in the first row and second columnof the first image in the lower left corner of FIG. 9 is G3, and aluminance value of the pixel in the first row and second column of thefirst image in the lower right corner of FIG. 9 is G4, where

the second luminance value G′=G2+G3+G4. The second target luminancevalue total G corresponding to the pixels in the first row and firstcolumn of the target image is G1+G′=G1+G2+G3+G4. Then the luminancevalue of the pixel in the first row and second column of the targetimage is increased to the total G.

According to the similar method mentioned above, the luminance value ofeach pixel in the target image may be increased. Then the target imagein which the brightness of each pixel is increased is taken as the imagephotographed by the under-screen camera assembly 220 for the targetobject.

In other words, if the distance between the color cameras of theunder-screen camera assembly 220 is very close, the difference betweeneach first image may be ignored, and all the pixels in each first imagemay be directly used to increase the brightness of the target imageinstead of pre-calibrating the target area, which improves the imageprocessing speed while increasing the brightness of the imagephotographed by the under-screen camera assembly 220.

FIG. 10 is a schematic structural diagram of an embodiment of an imageprocessing apparatus according to a second aspect of this application.The image processing apparatus 1000 provided in this embodiment of thisapplication includes:

an image obtaining module 1010, configured to obtain a first imagephotographed by each of N color cameras in the M color cameras;

a luminance value obtaining module 1020, configured to obtain, for eachfirst image, luminance values of at least a part of pixels in the firstimage; and

a brightness increasing module 1030, configured to increase brightnessof a target image by using the obtained luminance values, and use thetarget image with increased brightness as an image photographed by theunder-screen camera assembly, the target image being the first imagephotographed by one of the N color cameras.

In this embodiment of this application, the luminance values of the atleast a part of pixels in the first image collected by each color camerathat is disposed at a side of a second surface 210 b of a display panel210 and that is corresponding to a light-transmitting area 210 c areused to increase the brightness of the target image, and the targetimage with increased brightness is used as an image photographed by theunder-screen camera assembly 220, thereby increasing the brightness ofthe image photographed by the under-screen camera assembly 220 whilerealizing the full-screen display.

In this embodiment of this application, the luminance value obtainingmodule 1020 includes:

a target photographing distance obtaining unit, configured to obtain atarget photographing distance between the under-screen camera assembly220 and the target object of the under-screen camera assembly 220;

a target area determining unit, configured to obtain a target area ofeach first image at the target photographing distance based on apredetermined target area in an image photographed by each color cameraat pre-stored different photographing distances; and

a first luminance value obtaining unit, configured to obtain, for eachfirst image, a luminance value of each pixel in the target area of thefirst image.

In this embodiment of this application, a predetermined target area of apre-stored image photographed by the color camera at any photographingdistance is a position area in which the target object is located in theimage.

In this embodiment of this application, the brightness increasing module1030 is configured to:

use each pixel in a target area of the target image as a first targetpixel; and

add, for each first target pixel, a luminance value of the first targetpixel to a first luminance value to obtain a first target luminancevalue, and increase the luminance value of the first target pixel to thefirst target luminance value, where

the first luminance value is a sum of luminance values of pixelscorresponding to the first target pixel in a target area of each firstimage other than the target image.

In this embodiment of this application, the brightness increasing module1030 is further configured to:

increase an obtained luminance value of each pixel in a non-target areaof the target image by a preset multiple, where the preset multiple isN−1 times.

In this embodiment of this application, the luminance value obtainingmodule 1020 is configured to:

obtain, for each first image, luminance values of all pixels in thefirst image.

In this embodiment of this application, the brightness increasing module1030 is further configured to:

use each pixel in the target image as a second target pixel; and

add, for each second target pixel, a luminance value of the secondtarget pixel to a second luminance value to obtain a second targetluminance value, and increase the luminance value of the second targetpixel to the second target luminance value, where

the second luminance value is a sum of luminance values of pixelscorresponding to the second target pixel in each first image other thanthe target image.

According to a third aspect, this application further provides anelectronic device, including:

an under-screen camera assembly, including M color cameras; and

an image processing apparatus, configured to obtain a first imagephotographed by each of N color cameras in the M color cameras; obtain,for each first image, luminance values of at least a part of pixels inthe first image; and increase brightness of a target image by using theobtained luminance values, and use the target image with increasedbrightness as an image photographed by the under-screen camera assembly,the target image being the first image photographed by one of the Ncolor cameras, where

both M and N are integers greater than or equal to 2, and N is less thanor equal to M.

The electronic device provided in this embodiment of this applicationmay include the display panel 210 in FIG. 2 . In the electronic deviceaccording to this embodiment, the under-screen camera assembly may bethe under-screen camera assembly 220 described above with reference toFIG. 2 and any embodiment thereof. The image processing apparatus may bethe image processing apparatus 1000 described with reference to FIG. 10and any embodiment thereof.

According to a fourth aspect, this application further provides anelectronic device, including:

a memory, configured to store a program; and

a processor, configured to run a program stored in the memory to executeeach step in the image processing method according to the embodiments ofthis application, where the method includes: obtaining a first imagephotographed by each of N color cameras in the M color cameras;obtaining, for each first image, luminance values of at least a part ofpixels in the first image; and increasing brightness of a target imageby using the obtained luminance values, and using the target image withincreased brightness as an image photographed by the under-screen cameraassembly 220, the target image being the first image photographed by oneof the N color cameras.

The electronic device provided in this application can implement eachprocess in any embodiment of the foregoing image processing methodaccording to the first aspect of this application. To avoid repetition,details are not described herein again. In this embodiment of thisapplication, the luminance values of the at least a part of pixels inthe first image collected by each color camera that is disposed at aside of a second surface 210 b of a display panel 210 and that iscorresponding to a light-transmitting area 210 c are used to increasethe brightness of the target image, and the target image with increasedbrightness is used as an image photographed by the under-screen cameraassembly 220, thereby increasing the brightness of the imagephotographed by the under-screen camera assembly 220 while realizing thefull-screen display.

FIG. 11 is a schematic structural diagram of an embodiment of anelectronic device according to a fourth aspect of this application.

The electronic device 1100 includes but is not limited to componentssuch as a radio frequency unit 1101, a network module 1102, an audiooutput unit 1103, an input unit 1104, a sensor 1105, a display unit1106, a user input unit 1107, an interface unit 1108, a memory 1109, aprocessor 1110, and a power supply 1111. The electronic device 1100further includes a first screen and a second screen. A person skilled inthe art may understand that the structure of the electronic device shownin FIG. 11 constitutes no limitation on the electronic device. Theelectronic device may include more or fewer components than those shownin the figure, or a combination of some components, or an arrangement ofdifferent components. In this embodiment of this application, theelectronic device includes but is not limited to a mobile phone, atablet computer, a notebook computer, a palmtop computer, avehicle-mounted terminal, a wearable device, a pedometer, or the like.

The processor 1110 is configured to obtain a first image photographed byeach of N color cameras in the M color cameras; obtain, for each firstimage, luminance values of at least a part of pixels in the first image;and increase brightness of a target image by using the obtainedluminance values, and use the target image with increased brightness asan image photographed by the under-screen camera assembly 220, thetarget image being the first image photographed by one of the N colorcameras.

In this embodiment of this application, the luminance values of the atleast a part of pixels in the first image collected by each color camerathat is disposed at a side of a second surface 210 b of a display panel210 and that is corresponding to a light-transmitting area 210 c areused to increase the brightness of the target image, and the targetimage with increased brightness is used as an image photographed by theunder-screen camera assembly 220, thereby increasing the brightness ofthe image photographed by the under-screen camera assembly 220 whilerealizing the full-screen display.

It should be understood that, in this embodiment of this application,the radio frequency unit 1101 may be configured to receive and sendinformation, or receive and send signals during a call. For example, theradio frequency unit receives downlink data from a base station, sendsthe downlink data to the processor 1110 for processing, and sends uplinkdata to the base station. Generally, the radio frequency unit 1101includes but is not limited to: an antenna, at least one amplifier, atransceiver, a coupler, a low noise amplifier, a duplexer, and the like.In addition, the radio frequency unit 1101 may further communicate withanother device by using a wireless communications system and network.

The electronic device provides users with wireless broadband Internetaccess through the network module 1102, for example, helps users receiveand send e-mails, browse web pages, and access streaming media.

The audio output unit 1103 can convert audio data received by the radiofrequency unit 1101 or the network module 1102 or stored in the memory1109 into an audio signal, and output the audio signal into sound.Moreover, the audio output unit 1103 may further provide an audio output(for example, call signal receiving sound and message receiving sound)related to a specific function performed by the electronic device 1100.The audio output unit 1103 includes a speaker, a buzzer, a telephonereceiver, and the like.

The input unit 1104 is used to receive audio or video signals. The inputunit 1104 may include a graphics processing unit (GPU) 11041 and amicrophone 11042. The graphics processing unit 11041 processes imagedata of a static picture or a video obtained by an image captureapparatus (for example, a camera) in a video capture mode or imagecapture mode. A processed image frame may be displayed on the displayunit 1106. The image frame processed by the graphics processing unit11041 may be stored in the memory 1109 (or other storage medium) or sentby using the radio frequency unit 1101 or the network module 1102. Themicrophone 11042 may receive a sound and can process the sound intoaudio data. The processed audio data may be converted, in a call mode,into a format that may be sent by the radio frequency unit 1101 to amobile communication base station for output.

The electronic device 1100 further includes at least one sensor 1105,for example. a light sensor, a motor sensor, and another sensor. Thelight sensor includes an ambient light sensor and a proximity sensor.The ambient light sensor can adjust brightness of a display panel 11061according to ambient light brightness. The proximity sensor can switchoff the display panel 11061 and/or backlight when the electronic device1100 moves close to an ear. As a type of the motion sensor, anaccelerometer sensor may detect an acceleration value in each direction(generally, three axes), and detect a value and a direction of gravitywhen the accelerometer sensor is static, and may be configured torecognize a mobile terminal posture (such as screen switching betweenlandscape and portrait modes, a related game, or magnetometer posturecalibration), a function related to vibration recognition (such as apedometer or a knock), and the like. The sensor 1105 may further includea fingerprint sensor, a pressure sensor, an iris sensor, a molecularsensor, a gyroscope, a barometer, a hygrometer, a thermometer, aninfrared sensor, and the like. Details are not described herein again.

The display unit 1106 is configured to display information entered by auser or information provided for the user. The display unit 1106 mayinclude a display panel 11061, and the display panel 11061 may beconfigured in a form of a liquid crystal display (LCD), an organiclight-emitting diode (OLED), or the like.

The user input unit 1107 can be configured to receive entered number orcharacter information, and generate key signal input related to usersettings and function control of the electronic device. The user inputunit 1107 includes a touch panel 11071 and other input devices 11072.The touch panel 11071 is also referred to as a touchscreen, and maycollect a touch operation performed by a user on or near the touch panel(for example, an operation performed by the user on the touch panel11071 or near the touch panel 11071 with any suitable object oraccessory such as a finger or a stylus). The touch panel 11071 mayinclude two parts: a touch detection apparatus and a touch controller.The touch detection apparatus detects a touch direction of the user,detects a signal carried by a touch operation, and transmits the signalto the touch controller. The touch controller receives touch informationfrom the touch detection apparatus, converts the touch information topoint coordinates, and sends the point coordinates to the processor1110, and receives and executes a command sent by the processor 1110. Inaddition, the touch panel 11071 may be implemented in a plurality offorms, such as a resistive type, a capacitive type, an infrared ray anda surface acoustic wave. In addition to the touch panel 11071, the userinput unit 1107 may further include another input device 11072. Theanother input device 11072 may include, but is not limited to, aphysical keyboard, a functional button (such as a volume control buttonor a power on/off button), a trackball, a mouse, and a joystick. Detailsare not described herein again.

Optionally, the touch panel 11071 may cover the display panel 11061.When detecting a touch operation on or near the touch panel 11071, thetouch panel 11071 transmits the touch operation to the processor 1110 todetermine a type of a touch event. Then the processor 1110 provides acorresponding visual output on the display panel 11061 based on the typeof the touch event. Although in FIG. 11 , the touch panel 11071 and thedisplay panel 11061 are configured as two independent components toimplement input and output functions of the electronic device, in someembodiments, the touch panel 11071 and the display panel 11061 can beintegrated to implement the input and output functions of the electronicdevice. Details are not limited herein.

The interface unit 1108 is an interface for connecting an externalapparatus and the electronic device 1100. For example, the externaldevice may include a wired or wireless headphone port, an external powersupply (or a battery charger) port, a wired or wireless data port, astorage card port, a port used to connect to a device having an identitymodule, an audio input/output (I/O) port, a video I/O port, a headsetport, and the like. The interface unit 1108 can be configured to receiveinput from an external apparatus (for example, data information andpower) and transmit the received input to one or more elements in theelectronic device 1100, or can be configured to transmit data betweenthe electronic device 1100 and the external apparatus.

The memory 1109 may be configured to store a software program andvarious data. The memory 1109 may mainly include a program storage areaand a data storage area. The program storage area may store an operatingsystem, an application for at least one function (for example, a soundplay function or an image play function), and the like. The data storagearea may store data created based on use of the mobile phone (forexample, audio data or an address book), and the like. In addition, thememory 1109 may include a high-speed random access memory, or mayinclude a nonvolatile memory, for example, at least one disk storagedevice, a flash memory, or another volatile solid-state storage device.

The processor 1110 is a control center of the electronic device andconnects all parts of the electronic device using various interfaces andcircuits. By running or executing software programs and/or modulesstored in the memory 1109 and by calling data stored in the memory 1109,the processor 1110 implements various functions of the electronic deviceand processes data, thus performing overall monitoring on the electronicdevice. The processor 1110 may include one or more processing units. Theprocessor 1110 may be integrated with an application processor and amodem processor. The application processor mainly processes an operatingsystem, a user interface, an application, and the like. The modemprocessor mainly processes wireless communication. It may be understoodthat alternatively, the foregoing modem processor may not be integratedinto the processor 1110.

The electronic device 1100 may further include the power supply 1111(for example, a battery) supplying power to various components. Thepower supply 1111 may be logically connected to the processor 1110through a power management system, so as to implement functions such asmanaging charging, discharging, and power consumption through the powermanagement system.

In addition, the electronic device 1100 includes some functional modulesnot shown. Details are not described herein.

According to a fifth aspect, this application further provides anon-transitory computer-readable storage medium. The non-transitorycomputer-readable storage medium stores a computer program. The computerprogram, when executed by a processor, implements the processes of anyembodiment of the image processing method according to the first aspectof this application, and a same technical effect can be achieved. Toavoid repetition, details are not described herein again. Thenon-transitory computer-readable storage medium may include a read-onlymemory (ROM), a random access memory (RAM), a magnetic disk, or anoptical disc.

It should be noted that in this specification, the terms “comprise”,“include” and any other variants thereof are intended to covernon-exclusive inclusion, so that a process, a method, an article, or anapparatus that includes a series of elements not only includes thesevery elements, but may also include other elements not expressly listed,or further include elements inherent to this process, method, article,or apparatus. An element limited by “includes a . . . ” does not,without more constraints, preclude the presence of additional identicalelements in the process, method, article, or device that includes theelement.

Various aspects of the present disclosure are described with referenceto the flowcharts and/or block diagrams of the method, the apparatus(system) or the computer program product in the embodiments of thepresent disclosure. It should be understood that each block in theflowcharts and/or block diagrams and a combination of blocks in theflowcharts and/or block diagrams can be implemented by the computerprogram instructions. These computer program instructions may beprovided to a processor of a general-purpose computer, a special-purposecomputer, or other programmable data processing apparatus to produce amachine that enables these instructions, which are executed via theprocessor of a computer or other programmable data processing apparatus,to implement functions/actions specified in one or more blocks of theflowcharts and/or block diagrams. This processor may be, but is notlimited to a general-purpose processor, a special-purpose processor, anapplication-specific processor, or a field programmable logic array. Itshould also be understood that each block in the block diagrams and/orflowcharts and combinations of the blocks in the block diagrams and/orflowcharts may also be implemented by a dedicated hardware-based systemfor executing specified functions or actions, or may be implemented by acombination of dedicated hardware and computer instructions.

The embodiments of this application are described above with referenceto the accompanying drawings, but this application is not limited to theforegoing specific implementations. The foregoing specificimplementations are merely schematic instead of restrictive. Underenlightenment of this application, a person of ordinary skills in theart may make many forms without departing from aims of this applicationand the protection scope of claims, all of which fall within theprotection of this application.

What is claimed is:
 1. An image processing method, performed by anelectronic device, wherein the electronic device comprises anunder-screen camera assembly, the under-screen camera assembly comprisesM color cameras, and the method comprises: obtaining a first imagephotographed by each of N color cameras in the M color cameras;obtaining luminance values of at least a part of pixels in the firstimage for each first image; and increasing brightness of a target imageby using obtained luminance values, and using the target image withincreased brightness as an image photographed by the under-screen cameraassembly, the target image being the first image photographed by one ofthe N color cameras, wherein both M and N are integers greater than orequal to 2, and N is less than or equal to M.
 2. The method according toclaim 1, wherein the obtaining luminance values of at least a part ofpixels in the first image for each first image comprises: obtaining atarget photographing distance between the under-screen camera assemblyand a target object of the under-screen camera assembly; obtaining atarget area of each first image at the target photographing distancebased on a predetermined target area in an image photographed by eachcolor camera at pre-stored different photographing distances; andobtaining, for each first image, a luminance value of each pixel in thetarget area of the first image.
 3. The method according to claim 2,wherein a predetermined target area of a pre-stored image photographedby the color camera at any photographing distance is a position area inwhich the target object is located in the image.
 4. The method accordingto claim 2, wherein the increasing brightness of a target image by usingobtained luminance values comprises: using each pixel in a target areaof the target image as a first target pixel; and for each first targetpixel, adding a luminance value of the first target pixel to a firstluminance value to obtain a first target luminance value, and increasingthe luminance value of the first target pixel to the first targetluminance value, wherein the first luminance value is a sum of luminancevalues of pixels corresponding to the first target pixel in a targetarea of each first image other than the target image.
 5. The methodaccording to claim 4, wherein the increasing brightness of a targetimage by using obtained luminance values further comprises: increasingan obtained luminance value of each pixel in a non-target area of thetarget image by a preset multiple, wherein the preset multiple is N−1times.
 6. The method according to claim 1, wherein the obtainingluminance values of at least a part of pixels in the first image foreach first image comprises: obtaining luminance values of all pixels inthe first image for each first image.
 7. The method according to claim6, wherein the increasing brightness of a target image by using obtainedluminance values comprises: using each pixel in the target image as asecond target pixel; and for each second target pixel, adding aluminance value of the second target pixel to a second luminance valueto obtain a second target luminance value, and increasing the luminancevalue of the second target pixel to the second target luminance value,wherein the second luminance value is a sum of luminance values ofpixels corresponding to the second target pixel in each first imageother than the target image.
 8. An electronic device, comprising: anunder-screen camera assembly, comprising M color cameras; and an imageprocessing apparatus, configured to obtain a first image photographed byeach of N color cameras in the M color cameras; obtain, for each firstimage, luminance values of at least a part of pixels in the first image;and increase brightness of a target image by using the obtainedluminance values, and use the target image with increased brightness asan image photographed by the under-screen camera assembly, the targetimage being the first image photographed by one of the N color cameras,wherein both M and N are integers greater than or equal to 2, and N isless than or equal to M.
 9. The electronic device according to claim 8,wherein the M color cameras are arranged in an array.
 10. The electronicdevice according to claim 8, wherein fields of view of all cameras inthe under-screen camera assembly have a same overlapping area.
 11. Theelectronic device according to claim 8, wherein the color cameracomprises: a lens, a lens holder, a filter component, a photosensitivechip, and a circuit board connected to the photosensitive chip, whereinthe lens holder is disposed on the circuit board, the lens and thefilter component are disposed on the lens holder, and the filtercomponent is located between the lens and the photosensitive chip. 12.An electronic device, comprising: a processor and a memory storingcomputer program instructions, wherein the electronic device furthercomprises an under-screen camera assembly, the under-screen cameraassembly comprises M color cameras, and the computer programinstructions, when executed by the processor, causes the electronicdevice to perform: obtaining a first image photographed by each of Ncolor cameras in the M color cameras; obtaining luminance values of atleast a part of pixels in the first image for each first image; andincreasing brightness of a target image by using obtained luminancevalues, and using the target image with increased brightness as an imagephotographed by the under-screen camera assembly, the target image beingthe first image photographed by one of the N color cameras, wherein bothM and N are integers greater than or equal to 2, and N is less than orequal to M.
 13. The electronic device according to claim 12, wherein thecomputer program instructions, when executed by the processor, causesthe electronic device to perform: obtaining a target photographingdistance between the under-screen camera assembly and a target object ofthe under-screen camera assembly; obtaining a target area of each firstimage at the target photographing distance based on a predeterminedtarget area in an image photographed by each color camera at pre-storeddifferent photographing distances; and obtaining, for each first image,a luminance value of each pixel in the target area of the first image.14. The electronic device according to claim 13, wherein a predeterminedtarget area of a pre-stored image photographed by the color camera atany photographing distance is a position area in which the target objectis located in the image.
 15. The electronic device according to claim13, wherein the computer program instructions, when executed by theprocessor, causes the electronic device to perform: using each pixel ina target area of the target image as a first target pixel; and for eachfirst target pixel, adding a luminance value of the first target pixelto a first luminance value to obtain a first target luminance value, andincreasing the luminance value of the first target pixel to the firsttarget luminance value, wherein the first luminance value is a sum ofluminance values of pixels corresponding to the first target pixel in atarget area of each first image other than the target image.
 16. Theelectronic device according to claim 15, wherein the computer programinstructions, when executed by the processor, causes the electronicdevice to further perform: increasing an obtained luminance value ofeach pixel in a non-target area of the target image by a presetmultiple, wherein the preset multiple is N−1 times.
 17. The electronicdevice according to claim 12, wherein the computer program instructions,when executed by the processor, causes the electronic device to perform:obtaining luminance values of all pixels in the first image for eachfirst image.
 18. The electronic device according to claim 17, whereinthe computer program instructions, when executed by the processor,causes the electronic device to perform: using each pixel in the targetimage as a second target pixel; and for each second target pixel, addinga luminance value of the second target pixel to a second luminance valueto obtain a second target luminance value, and increasing the luminancevalue of the second target pixel to the second target luminance value,wherein the second luminance value is a sum of luminance values ofpixels corresponding to the second target pixel in each first imageother than the target image.
 19. A non-transitory computer-readablestorage medium, wherein the non-transitory computer-readable storagemedium stores computer program instructions, and when the computerprogram instructions are executed by a processor, the method accordingto claim 1 is implemented.